Challenges about entropy. 
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The physical meaning of entropy is analyzed in the context of statistical, nuclear, atomic physics 
and cosmology. Only the microcanonical Boltzmann entropy leads to no contradictions in sev- 
eral simple, elementary and for thermodynamics important situations. The conventional canonical 
statistics implies several serious errors and misinterpretations. This has far reaching consequences 
for phase-separations as well for the usual formulations of the second law. Applications in cosmology 
suffer under the ubiquitous use of canonical statistics. New reformulations in terms of microcanon- 
ical statistics are highly demanded but certainly difficult. 



I. INTRODUCTION 



Entropy, S, is the characteristic entity of thermody- 
namics and thermostatistics pj. It distinguishes ther- 
modynamics from all other physics; therefore, its proper 
understanding is essential. However, this is sometimes 
obscured by frequent use of the Boltzmann-Gibbs canon- 
ical ensemble, and the thermodynamic limit. Also its 
relationship to the second law is often beset with con- 
fusion between external transfers of entropy d ext S and 
its internal production di nt S. The main source of the 
confusion is of course the lack of a clear microscopic and 
mechanical understanding of the fundamental quantities 
of thermodynamics like heat, external vs. internal work, 
temperature, and last not least entropy, at the times of 
Clausius and possibly even today. I got some encourage- 
ment from reading Redlich's critique . 

The second law of the necessary increase (or constancy) 
of the entropy has far reaching significance for all physics 
and especially for astro-physics and cosmology. This de- 
mands a new critical discussion of the basics of statistical 
mechanics and the use of the various ensembles. 

This contribution wants to give a first glance of these 
challenges. Of course it is not able to go into the details. 
This would demand a whole course in statistical physics. 
The author's work on statistical mechanics is given by 
and some recent ones 0, 0. His interpretation of 
the foundation of entropy and the second law is given in 
refs.n 



The boxes show the transparencies of my talk pre- 
sented at the XLIV international winter meeting on nu- 
clear physics in Bormio (Italy) - 2006, January 29- Febru- 
ary 5. I add a few more explanations. 



Plan of the talk 

Entropy by Clausius 
Entropy by Boltzmann 

Caratheodory 
Entropy by Prigogine 
Entropy by Tsallis 
Phase transitons 
Convexities of S(E) 
Long-range interactions, gravity 
Arrows of time 
Cosmological perspectives and speculations 



Clausius 0: 

Temperature = unambiguous control parameter of 
thermodynamics 



dS = 



dQ 
T 



"value of metamorphosis" 
or ENTROPY 

SECOND LAW : 
"Heat only flows from hot to cold" 



* 
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= uncompensated metamorphosis 
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Boltzmann-Planck 



S=k*lnW 



as written on Boltzmann's tomb-stone, with 



(1) 



W(E,N,V) = 
d 3N Pd 3N q _ r -^,, 

=number of initial states with 
the same macroscopic constraints 
= microscopic ignorance 



(2) 



=> no thermodynamic limit 
no cxtcnsivity 
no concavity 
no homogeneity, 
no Boltzmann-Gibbs (canonicality) £| 
no Carathcodory 
no Tsallis [iq| 



The Boltzmann-Planck formula has a simple but deep 
physical interpretation: W or S measure our ignorance 
about the complete set of initial values for all 6N mi- 
croscopic degrees of freedom which are needed to spec- 
ify the iV-body system unambiguously, ref. To have 
complete knowledge of the system we would need to know 
[within its semiclassical approximation the initial po- 
sitions and velocities of all N particles in the system, 
which means we would need to know a total of 67V val- 
ues. Then W would be equal to one and the entropy, S, 
would be zero. However, we usually only know the val- 
ues of a few macroscopic parameters that are conserved 
or change slowly with time, such as the energy, number of 
particles, volume and so on. We generally know very lit- 
tle about the positions and velocities of all the particles. 
The manifold of all these points in the 6iV-dim. phase 
space, consistent with the given conserved macroscopic 
constraints of E, N, V, ■ ■ ■ , is the microcanonical ensem- 
ble, which has a well-defined geometrical size W and, by 
equation Q, a non- vanishing entropy, S(E, N, V, ■ ■ ■ ). 
The dependence of S(E, N, V, ■ ■ ■ ) on its arguments de- 
termines completely thermostatics and equilibrium ther- 
modynamics. 

Clearly, Hamiltonian (Liouvillean) dynamics of the 
system cannot create the missing information about the 
initial values - i.e. the entropy S(E, N, V, ■ ■ ■ ) cannot 
decrease. As has been further worked out in ref. |j and 
more recently in ref.|(j the inherent finite resolution of 
the macroscopic description implies an increase of W 
or S with time when an external constraint is relaxed. 
Such is a statement of the second law of thermodynamics, 
ref. |12| . which requires that the internal production of en- 
tropy be positive or zero for every spontaneous process. 



Analysis of the consequences of the second law by the 
microcanonical ensemble is appropriate because, in an 
isolated system (which is the one relevant for the micro- 
canonical ensemble), the changes in total entropy must 
represent the internal production of entropy, see below, 
and there are no additional uncontrolled fluctuating en- 
ergy exchanges with the environment. 

II. SECOND LAW 



Second Law 

P. Glansdorf and I. Prigogine [T^ 



dS — dextS + di n tS 

dextS = positive, negative, or zero 

dintS > 0=Second Law (3) 

Thus the Second Law 
is explicitly and most clearly defined by 
MICROCANONICAL STATISTICS ! 



From our experience (see section 1111111 s ) we know that the 
fundamental microcanonical ensemble is not equivalent 
to the conventional canonical ensemble. This is the case 
just in the thermodynamically most interesting situa- 
tions: at phase separation see section <|III() . In order to 
have a correct formulation of the second law we must 
follow Boltzmann's or Prigogine 's [12 formulation of mi- 
crocanonical entropy. 

Already Clausius himself gave an illuminating example 
in |13| that clearly shows how the conventional (canoni- 
cal) formula: 



fails and is not automatically the correct expression of 
the entropy change: 

When an ideal gas suddenly streams under insulat- 
ing conditions from a small vessel with volume V\ into 
a larger one (V2 > Vi), neither its internal energy U or 
E, nor its temperature changes, nor external work done, 
but its internal (Boltzmann-)entropy Si„t e.q.Q with (j2J 
rises, by AS = Nln (V2/V1). This is also a clear example 
for a microcanonical situation where the entropy change 
by an irreversible metamorphosis of the system is abso- 
lutely internal. It has nothing to do with heat exchange 
with the surrounding as expressed by eq0J In this con- 
text see also my controversy with Jarzynski 0] . 

Then the second law becomes very simple and claims 
the increasing loss of information (rise of entropy) due the 
impossibility to distinguish the highly "fractal" distribu- 
tion in phase-space after some mixing dynamics from its 
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surrounding. I. e. the internal entropy a la Prigogine 
(E3) 01 the necessarily redundant macroscopic descrip- 
tion of the system becomes larger (information-loss) . 

This example demonstrates the problematic of the 
canonical description of thermo-statistics. This is even 



more evident when the original object of thermodynam- 
ics, the description of boiling water, is addressed. This 
is discussed in the next section. 



III. PHASE TRANSITIONS 

Phase-transitions in conventional (grand-canonical) statistics in the thermodynamic limit: 

Yang-Lee singularities. Why? 

=>■ Only homogeneous configuration^ 
No boiling water! ^= 
Are phase transitions really so trivial ??? 

Physical reason: 

►Strong inhomogeneities-< , 

^Internal surfaces < 

What is the difference between 



Solid 


Liquid 


Gas ? 


have surfaces 


no surface 


condensate volume less than external volume 


fills any volume 


surface has edges 


surface has no edges 




hard fixed 


flexible, adjusts to container 





=>- Moral: Avoid thermodynamic limit !-4= 
1 



BUT 

Without thermodynamic limit several gospels of 
conventional thermodynamics become obsolete: 

• Equivalence of canonical and microcanonical en- 
sembles 

• Legendre transform structure 

• Phase transitions exist only in the thermodynamic 
limit 

• Specific heat is ~<(&E) 2 > > 

• Extensivity of S, scaling with N 

• Concavity of S(E, N) 

• Rise of entropy is connected to trend towards uni- 
formization 

• Second Law only in infinite systems 
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Convexity of S(E) 

Example: 
Atomic cluster fragmentation gives 
detailed insight into region 
of phase-separation, here no Coulomb 
i ► most interesting physics 
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0.2 0.4 0.6 0.8 1.0 1.2 

"Compound nucleus ever" [15]? 



1.4 



1.6 



Caloric curve of 3000 Na atoms at a pressure of 1 atm with realistic interaction (c.f. 3]). The temperature T in Kelvin, 
the energy in eV/atom. Nf r the number of fragments, NJ^ = ^2 N i l the number of surface atoms of dimers and 
heavier ones. The four inserts give the fragment distribution at 4 characteristic energies over the intruder. E.g.: at 
0.442 eV 1:329 means 329 monomers, and 2:7.876 means 7.876 dimers, and 4:1.295 means 1.295 quadrimers on average. 
Below e ~ 0.33 eV 2999 atoms are condensed in a single liquid droplet and above e ~ 1.3 eV nearly all atoms are free 
(~ ideal gas). Color online 



The above example of the liquid-gas transition of first clearly over the latent heat from cx 0.3 to oc 1.3 electron 
order in a mesoscopic droplet clarifies the errors made by volt, the transition temperature is below the evaporation 
the recent works by |15j : Whereas the transition extends line from point 1 to 2. This is the region of evaporation 
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configuration as is clearly seen by the inserts. The tem- 
perature of this piece remains above the true transition 
temperature T tr . This is of course because phase sepa- 
ration is a microcanonical phenomenon characterized by 
a back-bending caloric curve, which does not exist in the 
canonical ensemble 5j. The final backbending is clearly 
seen beyond point 2. One might argue: the system is un- 
stable in the backbending region. This is wrong as under 
a control of the energy fluctuations (thermos-flask, large 
systems like the ocean). Then the intermediate region is 
very well accessible. 

As seen in the mass distribution of the fragments (in- 
serts) the quality of the distribution changes over the 
latent heat from evaporation-like (insert 1 to insert 2, 
called by Bowman et al. in a somewhat premature 
way "compound nucleus for ever") finally to multifrag- 
mentation at 3 and 4. As function of the dynamically 
conserved energy the weight e S( E )- E / T of the configu- 
rations with energy E in the definition of the canonical 
partition sum 



Z(T) 



,S(E)-E/T 



dE 



becomes here bimodal over the range of the latent heat. 

Thus, in contrast to what was claimed at this meet- 
ing, this bimodality over the latent heat is a necessary 
signal of any phase separation. In nuclear fragmentation 
the caloric curve T(E) is often dramatically modified by 
additional fission decays 0. 



IV. COSMOLOGICAL CHALLENGES 

In very recent times possible links between general rel- 
ativity and statistical mechanics became a topic of hot 
speculations. 

First the philosophical question whether the arrow of 
time as expressed by the second law of thermodynamics 
has anything to do with the development of the universe 
(cosmological arrow of time) was a topic already of Clau- 
sius pj. Recently Allahverdian and Gurzadyan discuss 
this in [l^. Uffink's 0] answer to this question is: "The 
arrow of time has nothing to do with the second law!" 
This shows the wide span of controversial opinions about 
this question. 

Allahverdian and Gurzadyan |16| assume that the sys- 
tem is coupled to a memory-loosing bath. I.e. the time 
evolution operator of the bath 

1. T(t, 0) = T(t) after a sufficiently long time t, which 
must still be short compared with the Poincare re- 
currence time. 

2. and the system relaxes to the stationary distribu- 
tion V s (t) -> V ( s st) . 

Both are of of course strong assumptions which imply the 
second law. 



The "ensemble probabilistic" interpretation of statis- 
tical mechanics [£| takes the fact seriously that knowing 
only a few macroscopic parameters of the system leaves 
the majority of degrees of freedom uncontrolled. There- 
fore this fixes only the ensemble of many microscopic real- 
izations of the system. Thermodynamics as also thermo- 
statistics can only describe the average (over the ensem- 
ble) behavior. Certainly there is nothing like a single 
"macroscopic state" with a discrete Poincare recurrence 
time. In general the whole ensemble will never recur. 

This, however, seems to have nothing to do with a cos- 
mological arrow of time and in contrast to Allahverdian 
and Gurzadyan ^(| I tend to agree with Uffink ^3 that 
it might be an advantage to abandon the idea of a rela- 
tion of the second law with the arrow of time. 



Different arrows of time: 

Allahverdyan and Gurzadyan |l6j : 

1. Thermodynamic arrow of time: 
second law 

2. Cosmological arrow of time: 
universe expands 

3. Psychological arrow of time: 

we only know about the past, not future 
we become older and more stupid 

4. Electromagnetic: 
retarded interaction 

5. Quantum-mechanical: 

wave-function during measurement collapses 



1^2? 

Deeper understanding of entropy !< 



Cosmological perspectives and speculations 

Common wisdom: 
Specific heat of self-gravitating system often negative. 

However, canonically: 
=>■ gravitating systems are not canonical -<= 
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V. CONCLUSION 



Black Hole : 

e.g.: Schwarzschild horizon: 
R = 2M = 2E 
A = 16ttM 2 
dA > 
~ dS > 

Hawking radiation, thermal spectrum: 



8irM 8irE 

negative specific heat ! 

Sbh = A/A = ttR 2 = 4ttM 2 

e.g.: Generalized Second Law: 

^initial — Sbh(M) + S m atter 

< S B h(M + M matt er) (5) 

=> Limits the number in -yi? 3 of 
different elementary fields with A < R 
When too many they disappear in black hole! 



This shows the challenge of a possible connection be- 
tween entropy and the horizon of black holes 0, . 

Explicitly the generalized second law eq.JSJ sets auto- 
matically an upper end to the spectrum of any system. 
S(E) is necessarily overall concave. If the energy of a 
system becomes too large it becomes so heavy that it 
implodes into a black hole. This also illuminates the ab- 
surdity of the Hagedorn constant temperature spectrum 
as recently discussed and beautifully demonstrated by 
Moretto HSiJ. 



The lesson I like to transfer here is that the canonical 
statistics is sometimes dangerously erroneous and must 
then be replaced by the microcanonical statistics. How- 
ever, nearly all works on cosmology ignore this fact. Cer- 
tainly, in general relativity a lot more work must be done 
along this challenge jal- Examples showing some of the 
perspectives are Ea . l23 | . 

In 0| is the remarkable sentence: "Entropy costs en- 
ergy and energy focuses light into a caustics of space- 
time. The caustics prevent light-sheets going on for 
ever." The finite size of light-sheets and the surface-area 
of the corresponding system determines entropy. This 
sentence characterizes the deep link between entropy and 
space-time and the specific significance of the micro- 
canonical statistics in contrast to any intensive (canoni- 
cal) description. There is a further important statement 
in 19]: "Entropy is a non-local phenomenon. Only in 
some approximation entropy can be described by a local 
flow of entropy density" , i.e. by an intensive (canonical) 
description. It is fascinating how the experience from or- 
dinary condensed matter and especially phase-transitions 
points to the same conclusion as cosmology: Entropy is 
non-local and depends primarily on the "extensive " con- 
trol parameters as energy. One may argue in view of 
the large scales of the universe, a local canonical approx- 
imation might be acceptable. However, gravity has also 
a long range. The ubiquitous negative heat capacity of 
self-gravitating system should be a warning. 
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